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A thinking-skills course at-Montana State University 
is described, along with recent issues concerning the potential 
effectiveness of such courses. Advantages and disadvantages of 
different designs for studying the effects of thinking-skills ^ 
training are also considered. The focus of the course is: hypothesis^- 
formation and evaluation, problem solving, decisipn making, 
reasoning, and memory. The general approach is to briefly review 
cognitive research, especially that which concerns coimnon pitfalls in 
thinking. Students are introduced to strategies to guide thinking, as 
well as to situations that illustrate the usefulness of different 
strategies. Practice in using the strategies is also provided, short 
writing assignments are incorporated, since writing skills and 
thinking skills seem to be linked, in addition to subjective 
techniques for assessing thinking-skills courses , the following 
objective techniques are discussed: final examinations, performance 
in other courses, intelligence or critical-thinking tests, and 
Piagetian tasks . It is suggested that multivariate statistical 
techniques be used to explore changes in the underlying structure of 
cognitive skills and knowledge. (SW) 
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A lingering question for cognitive and educational psycho- 
logists is whether or not thinking skills can be enhanced by 
using various kinds of instruction. This question has become 
increasingly important in recent years, as many universities 
(including Montana State University) have taken steps to 
implement or to revise a general core curriculum for all 
students. Typically, such a core of required coursers mxght 
include several basic skills courses, such aa writing, speech, 
and mathematics • Somu universities are now also requiring a 
general thinking-skills course for ail students. One reason 
why there has been a tendency to require such a course lately 
is that many people- -prof essors, legislators, and so on--^have 
observed that college students often do not seem to acquire 
basic critical thinking skills. Another reason is that cog- 
nitive approaches have come to dominate psychology, and. many 
cognitive psychologists have recently realized that attempts to 
apply the knowledge gained are im^^tant for the further 
development of the field. 

First, we wiJl briefly describe the main characteristics 
of a thinking-skills course that we have been teaching at 
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Hont-ana State University. Then we will discuss some recent 
issues concerning the potential effectiveness of such courses 
that arise from a consideration of the differences between the 
thinking of novices and experts on any particular sub^ject. 
Finally, we will discuss ^^dvontoges and disadvantages of 
different designs for research on the effects of thinking- 
skills training. ' 

THINKING-SKILLS COURSE 
For about the last ten years, one of us CRAB) has taught 
an upper-division course on cognitive processes. As the field 
has matured, the course has included more and more direct 
instruction in practical thinking skills. Eventually, this 
practical training was simply occupying too much of the course, 
and it was apparent that this instruction could easily be 
offered in a separate course. In deciding what to include in a 
beginning level thinking-skills course,. we naturally considered 
five majpr categories of cognitive skills* These five cate- 
gories, then, formed the focus of the course: hypothesis 
formation and evaluation, problem solving, decision making, 
reasoning, and memory* We expect that this selection might 
gradually change as our teaching of general thinking skills 
evolves* Nevertheless, we are currently satisfied with these 
emphases * 

Cognitive Strategies 

Our general approach is to briefly review cognitive 
research, especially that which concerns common pitfalls in 
thinking. Then we introduce the students to various strategies 
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to guide thinking^ illustrate the situationG in which certain 
strategies mey be useful, and provide exanplea and practice in 
the use of these strategies. For example, we attempt to en* 
hance our students^ reasoning skills by introducing them to a 
specific strategy involving Venn diagrams, we teach them var- 
ious problem-solving heuristics, and we introduce a decision- 
making strategy involving decision trees « Because we cannot 
assume that all students have the same amount of knowledge in 
any particular domain, we try to generate enamples from the 
shared experiences of all of our students, mostly involving 
everyday situations. We will have more to say about the issue 
of teaching thinking in the context of domain-specific 
knowledge later. 
Managerial Strateg y 

Some research, such aa that of Schoenfeld <1979}, suggests 
that students who are taught cognitive strategies may not be 
able to use them because they seem to lack the metaco^jnitive 
skills needed to organize their use of the strategies* In 
earlier tines, the difficulty might have been seen to cause a 
failure if the instruction to "transfer" into the everyday 
realm. One possible solution to the problem is to accompany 
the instruction in cognitive strategies with a general meta- 
cognitive plan--what Schoenfeld refers to as a "managerial 
strategy," and what others refer to as "executive control." A 
diagram of such a managerial strategy resembles a flow-chart 
depicting the major steps required from an initial analysis of 
a problem situation to the evaluation of a tentative solution. 
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Recursive loops are explicitly built in to depict «nd circum^ 
vent the M^iny dead-ende that even an expert jRight encounter. 
In the past# we have Gx«ply taught Schoenfeld^s dia9rQiii--his 
managerial etrategy; but in the future, we plan to have 
students construct their own overall plan,, then compare it with 
one like Schoenfeld^s. 
Ecological Relevance 

Another possible way of solving the '"transfer" problem is 
to use many different kinds of everyday exasplee to illustrate 
the wide range of potential use of cognitive strategies. As a 
generalization fros some past research, using abstract, puzzle- 
like problems with little "real -world" relevance seems contra- 
indicated. Some of the previous attempts to teach general 
thinking skills were probably doomed to failur rem the start 
because of the lack of ecological relevance of the exercises 

a 

and examples. Our goal for a thinking-skills course should not 
merely be to improve performance on standard intelligence, 
aptitude, or critical-thinking tests. Those kinds of test© 
often contain rather artificial items with little or no eco- 
logical validity. 
Writing and Thinking 

Much recent work suggests that there is an intimate link 
between the development of skills needed to write clear 
expository prose and the development of effective thinking 
skills. Whenever possible we have tried to incorporate short 
writing assignments in our course. We think that this may be 
especially important whenever some more abstract or math- 
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Q»aticQl strategy or technique is taught, such as Bayes^ 
theoram. In general, though, having to write a description of 
various techniques, various stages in problem solving, or 
various types of decisions probably brings students to a deeper 
understanding of the interrelationships among the components 
involved. Thua^ writing assignments are an essential aspect of 
our thinking-skills course* 

THINKING AND DOMAIN-SPECIFIC KNOWLEDGE 

Recently, some research on the cognitive processes of 
experts and the development of expert systems has become cited 
with grater frequency by some cognitive scientists. This 
evidence seems to suggest that any attempt to teach general 
thinking skills is likely to fail. Resnick <1983a>, for 
example, argued in a recent article in Science that cognitive 
performance depends intimately on knowledge related to a 
specific taskf not merely ''disembodied ^processes of thinking 
(p. 47S> , This claim seems quite appropriate in the light of 
what is known about cognitive processes. However # in a aub- 
sequent letter Resnick C19S3b) asserted that specific knowledge 
affe. ^» the form of a person's reasoning and that "if reasoning 
can b#a taught^ it can probably only be done in the context of 
specific domains of knowledge*' (p. 1006) « 

In a recent review article^ Glaser <1SS4> suggested 
similarly that "thinking is greatly influenced by experience 
with new information" <p. 98). He argued that a broad spectrum 
of thinking skills might be more effectively enhanced while 
providing education in content-specific domains of knowledge 
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than by teaching special thinking-skills courses or programs. 
In short, both Resnick and Glaser have argued that the 
available evidence indicates the futility of attempting to 
teach general thinking skills outside the context of domain- 
specific knowledge and training. 

One of us has recently asserted that there is actually 
little or no evidence that thinking la not able to be enhanced 
by general thini^ing-skills courses or programs <Block» in 
press). Instead, the meager evidence that is available 
suggests that general thinking*skills courses or programs might 
have a substantial, positive effect that will be tranaf errable 
into a variety of content*specif ic domains. What we desperate- 
ly need at the present time is additional evidence that there 
are ways of teaching general thinking skills which will produce 
a long-lasting enhancement of the students' ability to think 
ef f ectively*"-a«d to do so in a wide variety of contexts and 
situations. Unless we are able to provide that, sort of 
evidence rather quickly, theoretical arguments like those of 
Resnick and Glaser will necessarily be recognized as valid. We 
think that we need much more evidence before we can even begin 
to understand the complex relationships between general 
thinking--skills training^ domain-specific knowledge, and 
tranaf BT of training. 

ASSESSING THINKING-SKILLS COURSES 

Unfortunately, much of the evidence that is needed is 
difficult to obtain. Nevertheless, let us take a critical look 
at the asseeeiiient of thinking akiXIs. As we argued earlier, it 
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is assent ial that we assess the progress made in enhancing the 
critical thinking skills of our students. The development of 
thinking-skills courses or programs must be accompanied by the 
use of appropriate assessiment techniques. 
Subiective Techniques 

Generally speaking^ assesament can either be subjactive or 
objective. The subjective techniques are interesting^ but not 
very convincing to most people because of biases^ demand 
characteristics, and so on. Subjective assessment can be 
obtained from the professor, the students, or both. It would 
be surprising indeed if the professor were not enthusiastic 
about the effects of the course, snd we evaluate our thinking- 
skills course positively. Our students> though, «re also very 
positive. In addition to using a more traditional course 
evaluation form, we asked our students: "Do you feel that you 
are a better thinker as a result of having taken this course?" 
Nearly all said ''yes", citing such changes as: "1 have learned 
to look in depth at problems," "I think things through," "I 
have learned more ways to solve problems arJ a morp creative 
way of thinking," and so on. A positive attitude is important, 
and our students seem to have one. 
Obi active Techniques 

Final examination . Naturally, a skeptic will remain 
skeptical, so we need to use some objective kinds of measures. 
But what? We could compare the performance of our students on 
a final course exam with that of a matched control group » 
However, if the exam contains items on which our students 
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received direct instruction, no one would be terribly aurpriaed 
if their performance was better. 

Performance in other couraeg . We could look at a per/ion^a 
overall grade-point average following the course. Unfortunate- 
ly, at many universities critical-thinking skills might tend to 
be punished rather than rewarded, especially if the student 
challenges a professor^'s thinking on some topic. Further, we 
cannot control differences in the difficulty level of courses 
which students elect to take. 

Intelligence or critical-thinking testa . Another proposed 
way of assessing improvements in thinking is to see whether or 
not intelligence or critical -thinking test scores are higher 
after taking a course. Evidence indicates that, in fact, IQ 
scores can be increased ae a result of inten^ve problem- 
solving or thinking-^skills programs (see Sternberg & Detterman, 
1983). However, there is the lingering question of whether or 
not these improvements are merely the result of training in 
test-taking--what is called •'teaching for the test"--rather 
than truly g^neral enhufftrements of thinking skills. 

Pi agetian tasks . Much the same could be said about the 
apparent progression of some thinking-skills students from 
concrete operational thought into formal operational thought. 
Although this might reflect a broadly applicable enhancement oi 
thinking skills, we again do not know to what extent the teach-* 
ing program he© taught students simply to perform well on the 
Piagetian tasks. 
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Thinking Skills and Knowledge Structures 

The major problem with all of these assessment techniques 
XB that one never knows the e^ctent to which ^ the thinking skills 
that hQve been taught are restricted in generality to those 
that ai;e required ILo perform well on the teat. There are a few 
ways around this problem, though. 

First ,r one could explicitly teach only a subset o£ the 
ski lis- -those necessary to perfor» well on «ibout half of the 
xtQTk types on the criterion test--and not teach another subset 
of ski lis- -those necessary to perform well on another half of 
the ite» types on the test. Then one could see the extent to 
which thinking skills necessary to perforn well on the latter 
subset of test-item types tre either the same as or are 
transferrable fro» the skills that were explicitly taught. The 
main drawback to this type of thinking-skills instruction is 
that it i« ^till "teaching for the test"- -even if only for 
about half of the it^m types on the test. Few instructors a. 3d 
even fewer students would find this kind of instruction 
satisfying. 

There is another alternative, however. Rather than assess 
performance on a criterion test solely in terms of th© number 
of. correct responses* one couJd use multivariate statistical 
techniques, such as cluster analysis and factor analysis, to 
explore changes in the underlying structure of cognitive skills 
and knowledge • 

One excellent example of this kind of technique is the 
work of Schoenfeld and Herrmann <1982)* They were interested 
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in differences between expert and novice mathematical problem 
solvers, specifically^ in the perception of problems and in the 

underlying ^'knowledge structures." Rather than testing their 

X * 
subjects on mathematical problems and scoring performance in 

terxs of correct or incorrect answers, thay asked subjects 

sinply to categorize a number of mathematical problems. 

Subjects sorted the problems into different piles on the basis 

/ 

of their simdiarity. A cluster analysis revealed that math- 
ematical nov^'icds tended to classify problems on the basis of 
"surface structure However^ both mathematics professors and 
students who had taken an intensive IS-day course on problem- 
solving strategies tended to classify the test problems 
^according to principles relevant to problem solution- -what 
might be called a *'deep structure" of mathematics problems* 

We think that Schoenfeld and Herrmann'^ a research exhibits 
a powerful method for assessing changes in thinking skills in 
such a way that alternative explanations for the expected 
enhancements are ruled out • In addition p their research is a 
good example of the kind of work that is urgently needed on the"^ 
relationship between general thinking skills and domain- 
specific knowledge. 
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